arXiv:1506.08312vl [stat.ME] 27 Jun 2015 


Spatial-Sign based High-Dimensional 

Location Test 


Long Feng and Fasheng Sun 
Northeast Normal University 


Abstract 

In this paper, we consider the problem of testing the mean vector in the high¬ 
dimensional settings. We proposed a new robust scalar transform invariant test based 
on spatial sign. The proposed test statistic is asymptotically normal under elliptical 
distributions. Simulation studies show that our test is very robust and efficient in a 
wide range of distributions. 
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1 Introduction 

Assume Xi, • • • , X„ is an independent sample from p-variate distribution F(x — 6 ) located 
at p-variate center 6 . We consider the following one sample testing problem 

Ho : 0 = 0 versus Hi : 0 ^ 0 . 

One typical test statistic is Hotelling’s T^. However, it can not be applied when p > n — 1 
because of the singularity of the sample covariance matrix. Recently, many efforts have been 
devoted to solve the problem, such as Bai and Saranadasa (1996), Srivastava and Du (2008), 
Srivastava (2009), Chen and Qin(2010) and Park and Ayyala (2013). They established the 
asymptotic normality of their test statistics under the assumption of diverging factor model 
(Bai and Saranadasa 1996). Even this data structure generates a rich collection of X, it is 
not easily met in practice. Moreover, multivariate t distribution or mixtures of multivariate 
normal distributions does not satisfy the diverging factor model. This motivates us to 
construct a robust test procedure. 

Multivariate sign or rank is often used to construct robust test statistics in the multivari¬ 
ate setting. Especially, multivariate sign tests enjoy many desirable properties. First, those 
test statistics are distribution-free under mild assumptions, or asymptotically so. Second, 
they do not require stringent parametric assumptions, nor any moment conditions. Third, 
they have high asymptotic relative efficiency with respect to the classic Hotelling’s test. 
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especially under the heavy-tailed distributions. However, the classic spatial-sign test also 
can not work in the high-dimensional settings because the scatter matrix is unable to be 
estimated. Recently, without estimating the scatter matrix, Wang, Peng and Li (2014) pro¬ 
posed a high-dimensional nonparametric test based on the direction of Xj, i.e. Xj/||Xj||. 
Even it is workable and robust in high-dimensional settings, it loses all the information of 
the scalar of different variables and then is not scalar-invariant. In practice, different compo¬ 
nents may have completely different physical or biological readings and thus certainly their 
scales would not be identical. Srivastava (2009) and Park and Ayyala (2013) proposed two 
scalar-invariant tests under different assumption of correlation matrix. As shown above, 
they are not robust for the heavy-tailed distributions. In this paper, we proposed a new 
robust test based on spatial sign. We show that it is scalar invariant and asymptotic normal 
under some mild conditions. The asymptotic relative efficiency of our test with respect to 
Park and Ayyala (2013)’s test is the same as the classic spatial-sign test with respect to 
the Hotelling’s test. Simulation comparisons show that our procedure has good size and 
power for a wide range of dimensions, sample sizes and distributions. All the proofs are 
given in the appendix. 

2 Robust High-Dimensional Test 

2.1 The proposed test statistic 

Assume {Xi,..., X„} be a independently and identically distributed (i.i.d.) random samples 
from p-variate elliptical distribution with density functions det(S)“^/^p(||S“^/^(x — 0 )||) 
where 0 ’s are the symmetry centers and S’s are the positive definite symmetric px p scatter 
matrices. The spatial sign function is defined as U{x.) = ||x||“^x/(x 7 ^ 0). In traditional 
fixed p circumstance, the following so-called “inner centering and inner standardization” 
sign-based procedure is usually used (cf.. Section 6 of Oja 2010) 

Ql = npU^U, (1) 

where tj = \ Uj = 17(S“^/^Xjj), are Tyler’s scatter matrix. is affine- 

invariant and can be regarded as a nonparametric counterpart of Hotelling’s test statistic 
by using the spatial-signs instead of the original observations Xjj’s. However, when p > n, 
is not defined as the matrix is is not available in high-dimensional settings. 

Motivated by Hettmansperger and Randles (2002), we suggest to find a pair of diagonal 
matrix D and vector 6 for each sample that simultaneously satisfy 

-^U{ej) = 0 and -diag<^U{ej)U{ej)'^ [ =lp, ( 2 ) 

^ i=i ^ I i=i J 

where sj = D"^A(xj — 0). (D, 0) can be viewed as a simplified version of Hettmansperger- 
Randles (HR) estimator without considering the off-diagonal elements of S. We can adapt 
the recursive algorithm of Hettmansperger and Randles (2002) to solve ([2]). That is, repeat 
the following three steps until convergence: 
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(i) e,f-D-V2(x,.-0), j = 


(ii) e^e + 




(iii) D 4-pD^/^diag{n ^ 

The resulting estimators of location and diagonal matrix are denoted as 6 and D. We may 
use the sample mean and sample variances as the initial estimators. 

Then, we dehne the following test statistic 

= ;^E Et' (oy/^x,) 

V / A 


where are the corresponding diagonal matrix estimator using leave-two-out sample 


2.2 Asymptotic results 


We need the following conditions for asymptotic analysis: 
(Cl) tr(R4) = o(tr2(R2)), where R = D"V2y;D-V2; 


(C2) n ^p^/tr(R^) = 0(1) and logp = o(n); 


(C3) (tr(R^) — p) = o{n ^p^). 


Condition (Cl) is the same as the condition (4) in Park and Ayyala (2013). To appreciate 
condition (C2) and (C3), we consider tr(R^) = 0(p) (Srivastava and Du 2008; Srivastava 
2009). Then, Condition (C2) and (C3) becomes p = O(n^) and p/n —)■ oo. Thus, we could 
allow the dimension being the square of the sample size. To get the consistency of the 
diagonal matrix, the dimension must diverging faster than the sample sizes. 

The following theorem establishes the asymptotic null distribution of Rn- 


Theorem 1 

2 _ 2 

n(n—l)p2 


Under Conditions (C1)-(C3) and Hq, as {p,n) —)■ oo, Rn/cTn A- N(0,1), where 
tr(R2). 


We propose the following estimators to estimate the trace terms in 


tr(R2) 



1 ) 


n n 


^^(C/(D-''^(X, 
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where {Oij, Oij) are the corresponding spatial median and diagonal matrix estimators using 
leave-two-out sample By Proposition 2 in Feng et ah (2014), tr(R2)/tr(R^) ^ 1 

as p, n —oo. Consequently, a ratio-consistent estimator of under Hq is = ^(^^i)p2 tr(R2). 
And then we reject the null hypothesis with a level of signihcance if Rn/3n > Za, where Za 
is the upper a quantile of A^(0,1). 

Next, we consider the asymptotic distribution of Rn under the alternative hypothesis 
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(C4) V = 0(coV„) where Co =-E(||D -/x)||). 

Theorem 2 Under Conditions (C1)-(C4), as {n,p) oo, 


Cl + V 

Theorem 1 and 2 allow us to compare the proposed test with some existing work in terms of 
limiting efficiency. In order to obtain an explicit expression for comparison use, we assume 
that Amax(p~^R-) = o{n~^) and then = o{a‘^). Thus, the asymptotic power 

of our proposed test under the local alternative is 


Psiu) = ^ 


—Za + 


clnpfi'^D \ 

) ■ 


In comparison. Park and Ayyala (2013) showed that the asymptotic power of their proposed 
test (abbreviated as PA hereafter) is 


f^PAiu) 


$ 


n/x^D ^/x \ 

cue) 


where D and R are the variance and correlation matrix of Xj, respectively. Thus, the 
asymptotic relative efficiency (ARE) of with PA test is 


ARE(R„,PA) 


clpfjCD ^/x I tr(R2) 
AX^D-1/x trine 


=clE{\\e\ 


where the last equality is followed by tr(R^) = tr(R^) and D = p“^E(||e|p)D. Similar to 
the proof of Theorem 1, under Condition (C3), we can show that cq = E(||e||“^)(l + o(l)). 
Thus, 


ARE(R,,PA) =E2(||e||-i)E(||e||2) 


If Xi are generated from multivariate t-distribution with u degrees of freedom (z/ > 2), 


ARE(R„, PA) 


( n(i,+i)/2) 

V r(>./2) 


2 


Table 1 reports the ARE with different u. Under the multivariate normal distribution (z/ = 
exo), our SS test is the same powerful as PA test. However, our SS test is much more powerful 
than PA test under the heavy-tailed distributions. 
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Table 1: ARE(i?„, PA) with different z/. 

z/ = 3 z^ = 4 z/ = 5 z/ = 6 u = oo 

ARE 2.54 1.76 1.51 1.38 1.00 


In contrast, Wang, Peng and Li (2014) showed that the power of their test (abbreviated 
as WPL) is 


- «> {-z. + ^ 1 =) 

where A = E(||£j||“^(Ip — U B = E{U{Si)U{£i)^) and Si = ^i — /x. First, if all 
the diagonal elements of S are equal, i.e. di = 5, under Condition (C3), we can show that 
A = coIp(l + o(l)) and tr(B^) = p“^(5^tr(R^). Then, 


/^wpl(m) 


$ 


—^a + 


Cgnp/x^D \ 


Thus, our SS test has the same power as WPL test in this case. However, their test is 
not scalar-invariant. To appreciate the effect of scalar-invariance, we consider the following 
representative cases. Let S be a diagonal matrix. The first half diagonal elements of S 
are all and the rest diagonal elements are all r|. The mean only shift on the hrst half 
components, i.e. /Xj = CA = 1, • • • ,p/2 and the others are zeros. Thus, 






1-1 


)C^ 




However, it is difficult to calculate the explicit form of (3wpl for arbitrary rf,r|. We only 
consider two special cases. If rf ^ r|. 




—Za + 


nE^(||6||-^)C^ \ 

J • 


Thus, ARE(R„,WPL) has a positive lower bound of l/\/2. However, if r| > rl 





nE^(|| 6 ||-^)C^ \ 

2v^r| J ■ 


Then, ARE(R„,WPL)=r|/(\/2rf) could be very large. This property shows the necessity of 
a test with the scale-invariance property. 


3 Simulation 

Here we report a simulation study designed to evaluate the performance of the proposed 
SS test. All the simulation results are based on 2,500 replications. The number of variety 
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of multivariate distributions and parameters are too large to allow a comprehensive, all- 
encompassing comparison. We choose certain representative examples for illustration. The 
following scenarios are firstly considered. 

(I) Multivariate normal distribution. Xj~iV(0,R). 

(II) Multivariate normal distribution with different component variances. Xj ~ N{6,'S), 
where S = and D = diag{dl,-- - ,dp}, d'j = 3, j < p/2 and = 1, 

3 > p/2. 

(III) Multivariate f-distribution tp^^. X/s are generated from with S = R. 

(IV) Multivariate f-distribution with different component variances. X/s are generated from 

fp 4 with S = and d^’s are generated from xl- 

(V) Multivariate mixture normal distribution MNp^..y^ 9 . X/s are generated from xfpiG, R) + 
(1 — x)fp{6, 9R), denoted by MNp^..y^ 9 , where /p(-; •) is the density function of p-variate 
multivariate normal distribution. 7 is chosen to be 0.9. 

Here we consider the correlation matrix R = (0.5l®“-^l)i<jj<p. Two sample sizes n = 50,100 
and three dimensions p = 200,400,1000 are considered. For power comparison, under Hi, we 
consider two patterns of allocation for fi. One is dense case, i.e. the first 50% components of 
^ are zeros. The other is sparse case, i.e. the first 95% components of are zeros. To make 
the power comparable among the configurations of Hi, we set p =: ||m|P/\/ tr^(S) = 0.03 
throughout the simulation. And the nonzeros components of are all equal. Table 2 reports 
the empirical sizes and power of SS, PA and WPL tests for multivariate normal (Scenario 
I and II) and non-normal (Scenario III, IV and V) distributions, respectively. From Table 
2, we observe that our SS test can control the empirical sizes very well in all cases. WPL 
test can also maintain the significant level very well. However, the empirical sizes of the 
PA tests is a little larger than the nominal level in many cases, especially for the non¬ 
normal distributions. Under Scenario I and H, PA test has certain advantages over SS as we 
would expert because the underlying distribution is multivariate normal. However, under 
the non-normal distributions, our SS test performs signihcantly better than PA test. It is 
consistent with the theoretical results in Section 2. When the component variances are same 
(Scenario I, HI and V), the power of our SS test is similar to WPL test. Even we need to 
estimate the scalar matrix, we do not lose much efficiency in these cases. However, when 
the component variances are not equal (Scenarios (H) and (IV)), our SS test, even PA test, 
are much more powerful than WPL test, which further shows that a scalar-invariant test 
is necessary. All these results show that our SS test is very powerful and robust in a wide 
range of distributions. 
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Table 2: Empirical sizes and power (%) comparison at 5% significance under Scenarios (I)- 

(V) 





Size 



Dense 



Sparse 


n 

P 

ss 

PA 

WPL 

SS PA 
Scenario I 

WPL 

SS 

PA 

WPL 

50 

200 

5.4 

6.2 

5.2 

29 

31 

29 

31 

33 

31 

50 

400 

6.5 

7.3 

6.6 

29 

33 

30 

31 

34 

31 

50 

1000 

4.7 

6.9 

5.7 

25 

33 

29 

25 

32 

29 

100 

200 

6.2 

6.5 

6.3 

61 

63 

61 

66 

68 

66 

100 

400 

5.9 

6.2 

5.1 

63 

64 

63 

67 

68 

68 

100 

1000 

5.3 

6.2 

5.3 

63 65 

Scenario II 

64 

66 

67 

67 

50 

200 

5.6 

6.3 

5.7 

63 

66 

25 

70 

72 

29 

50 

400 

6.5 

7.3 

5.4 

69 

72 

28 

69 

72 

30 

50 

1000 

4.6 

6.9 

6.1 

67 

74 

28 

66 

73 

28 

100 

200 

5.9 

6.3 

5.0 

95 

96 

62 

98 

97 

70 

100 

400 

5.9 

6.1 

6.2 

97 

97 

66 

98 

98 

71 

100 

1000 

5.3 

6.2 

6.3 

98 98 

Scenario III 

67 

98 

99 

68 

50 

200 

5.3 

4.3 

5.2 

51 

36 

51 

58 

40 

58 

50 

400 

6.4 

6.9 

6.6 

54 

39 

55 

57 

41 

58 

50 

1000 

4.4 

7.1 

5.7 

51 

37 

56 

51 

39 

57 

100 

200 

6.0 

7.8 

6.3 

89 

69 

89 

93 

72 

93 

100 

400 

5.9 

6.6 

5.1 

91 

66 

91 

93 

71 

93 

100 

1000 

5.4 

6.1 

5.3 

93 69 

Scenario IV 

93 

94 

70 

95 

50 

200 

5.3 

4.3 

6.5 

87 

67 

50 

92 

74 

58 

50 

400 

6.4 

6.9 

5.9 

89 

74 

56 

97 

88 

60 

50 

1000 

4.4 

7.1 

6.1 

99 

88 

57 

99 

92 

58 

100 

200 

6.0 

7.8 

6.0 

100 

94 

90 

100 

93 

94 

100 

400 

5.9 

6.6 

6.2 

100 

94 

92 

100 

95 

94 

100 

1000 

5.4 

6.1 

5.9 

100 99 

Scenario V 

94 

100 

97 

96 

50 

200 

5.5 

6.0 

5.2 

44 

34 

44 

51 

38 

50 

50 

400 

6.5 

6.8 

6.6 

49 

39 

50 

50 

40 

52 

50 

1000 

4.6 

7.1 

5.7 

44 

40 

50 

45 

39 

50 

100 

200 

6.2 

6.6 

6.3 

84 

67 

84 

89 

70 

89 

100 

400 

5.9 

5.1 

5.1 

87 

66 

87 

89 

71 

90 

100 

1000 

5.3 

5.8 

5.3 

89 

68 

89 

90 

71 

91 
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4 Appendix 


4.1 Proof of Theorem 1 

By Tyler’s expansion, 

17(Dr.i/2x,) = ^ p-i/2 _ d-V2)x,) 

= Ui - (Ip - U.Uf)(£)■•'/' - D-i/2)u, + op(n-i). 

Then, 


n{n — 1) 




i<j 


n{n — 1) 


^ EEufu^-^^^^EEurd^i”'-D-‘/=)(i,-u.upuj 


*<i 


i<j 


EnEEur(D5‘'''' - D-‘/")(Ip - U,Uf)(I,- U,Uj)(D.y" - 


n{n — 1) 


T^^r^-l /2 


i<j 


+ Op{n 


n{n — 1) 


+ Jnl + </n 2 + Op((J„) 


i<j 


Next, we will show that Jni = Op((T„). 


- D‘/")1I, - U,Uf|U, 


n(n — 1) 


i<j 


2 — ■nV 2 w- 2 


n(n — 1) 


5^5^Uf(DrV2_Di/2)u^,^ 


i<j 


n{n — 1) 


^5]ur(Dy''" - D'''")u,uru 


i<j 










Next we will show that E{G\^) = o(cr^ 


E (Gl,) 


n‘^{n — 1 ) 2 - 


i<j 


( - D^/ 2 )u, 


n‘^{n — !)■ 




i<j 


ur5.i/2D-i/2('f)-i/2 _ dV2)d-V25]V2u 


(1 + uf (R - Ip)ui)(l + uJ(R - Ip)uj 


- A^EEI^ - D‘/ 2 )d-'/ 2 eVV, 

^ ^ i<j ^ 


/ 


+ CE ( - Di/ 2 p~i/ 25 .i/ 2 ^ 


V 


+ CE ( (ufS^/ 2 D-^/ 2 ^Dr>/^-D^/ 2 p-i/ 25 .i/ 2 ^ 






where the last inequality follows by the Taylor expansion. Define H = — 

and then according to Lemma 2 in Feng et ah (2014), tr(F'(H^)) = o(tr(R^)) 
and tr(i?(H^)) = o(tr(R'^)) = o(tr^(R^)) by Condition (Cl). By the Cauchy inequality, we 
have 


F;(ufS^/2j3-i/2^j3-i/2 _ d 1/2 )d-V 25]V2^^,^2 ^ _ o(p-2tr (R^)), 

E((ufHuj)2uf(R-Ip)ui) < (E(ufHuj)^E((uf(R-Ip)ui)2)^/^ 

< (p-"tr(E(H"))p- 2 (tr(R - Ip)^)) V 2 
= o(p“V(R^)), 

E((ufHuj)2uJ(R-Ip)uj) < (E(ufHuj)^E((uf(R-Ip)uj)2)^/2 

< (p-"tr(E(H"))p- 2 (tr(R - Ip)^)) V 2 
= o(p“^tr(R^)). 


So we obtain that G„i = Op(cr„). Similarly, we can show that G „2 = Op(o'n) and then 
Jni = Op(an)- Taking the same procedure as Jni, we can also obtain Jn 2 = Op{an)- Moreover, 
by taking the same procedure to uf (R — Ip)uj as Gni, 


n{n — 1) 


EEufu, 


i<j 


n{n — 1) 


n{n — 1) 


EE 




i<j 


yi + uf(R - Ip)Ui,/l + uJ(R - Ip)u 




i<j 


Thus, 


Rn 


2 

n{n — 1) 
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Next, we will show that 


I n{n — l)p^ 2 


2 tr(R2) n{n — 1) 




i<j 


Dehne Wnk = Y!1=2 ^ni where Z^i = Y!jA Let J^n,i = cr{ui, • • • , uj 

be the a-held generated by {uj, j < i}. Obviously, E{Zni\J^n,i-i) = 0 and it follows that 
{Wnki J^n,k'i 2 < /c < n} is a zero mean martingale. The central limit theorem will hold if we 
can show 




Al. 




and for any e > 0, 


i =2 


(3) 


(4) 


It can be shown that 

n 

i=2 


n j—1 


J -0 


rri2 E E urs‘''"D-‘SD-'s‘/"u. 


nPln — 1)2 ^ ^ 

^ > 7=2 i=\ 


ri^in — 1)2 Z— 

' ' j =2 ii<i2 


n j—l j — 1 

E E E<S‘''^D-‘SD-'S‘-'^u, 


—Cnl + C'n2 


Simple algebras lead to 


var(C', 


16 


n—1 


nlj 


5^f(E((ujEL2D-iSD“isL2u^)2)-p-2tr2(R2)) 


n^(n — 1 )^ 

7 = 1 


By Lemma 1 in Feng et ah (2014), F'((uJS^'^^D ^SD ^E^/^Uj)2) = 0(p ^tr2(R2)). Thus, 
var(0„2) = o(cr^). Then, Cni/cr^^l. Similarly, E{Cn 2 ) = 0 and 


var(0, 


n2 


32 


at 


n^(n — 1 )^ Z- 


i{n-i + l)(i - 1) tr(R'^) p 

-^0 


i=3 


tr2(R2) 


implies Cn 2 = Op{a^). Thus, (E]) holds. It remains to show (jl]). Note that 


1=2 1=2 
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Accordingly, the assertion of this lemma is true if we can show 


E 




.i=2 



Note that 


.t =2 


n n /j—1 

Y, E{Z‘j) = 0{n-’>) ^ B 5^ uJS‘'=D-‘S‘'=u. 

j=2 j=2 \i=l 


which can be decomposed as 3Q + P where 

n j-1 j-1 

Q =0(n“®) Y1 sV 2 d- 15 ] 1 / 2 ^^, 

j=2 s<t 

n j-1 

P =0{n-^) Y Y 
j=2 i=l 

Obviously, Q = _ 0{n-^p-hP{ie)) = o{a^). 

Dehne ^ 

( p p 

EE 

i=l j=l 
P P 

= E E Viiji Vi2j2 '^isjs '^iiji ^ ( ^si2 ^si4 ) ^ ^ijs ) 

il,...,i4=l Ji,...,i4=l 

p p 

= o{p-^) Y J2 

il,...,j4 = l Jl,.--J4=l 

By the Cauchy inequality, we have 


'^*iii'^*2i2'^*3i3'^qi4 • 


E E 

n,*2,*3,*4=1 ii,i 2 ,t 3 j 4 =i 


'^iljl'^*2i2'^*3i3'^*4j4 — ^ 


-I «ti+4j2)«i3+4j4) 

*1,*2,*3,*4 = 1 il J2 J 3 J4=l 

P / ^ ^ 

/ ^ *ljl *2J2 I / ^ 

*ii*2ji,i2=i \*i,ii 


*ljl 


= tr^lR^' 


Thus, P = 0{n ^p '^tr(R^)) = o{a^). 


11 


4.2 Proof of Theorem 2 

By the Tyler’ expansion, 


f/(D.y"X.) =U, - (Ip - u.ufxoy'" - D-‘/")U 
■r'(I„ - ttUflD-'/V + oJn-^] 


Then, taking the same procednre as Theorem 1, we have 

Z’T’ur (I, - u.ur)D-‘/v 

^ ^ *<i ^ ^ i<j 


n{n — 1) 


mE Ev‘uf (Ip - u,uj)D-‘/v 


i<j 


+ ;^(;r:T) E E'T‘’'7 V’’D-'/^(ip - u.ufxip - u,uJ)d->/^m + 


Op[n 


- 2 '| 


i<j 


And 


9 _ _ 1 

—E Ev‘uf(Ip - U,Uj)D-‘/V = -Y, Coufs'/^D-V + Op(<T„), 


n{n — 1) 


i<j 


i=i 


-V 2 , 


n{n — 1) 


E’-r‘’-7V^D’‘'"(Ip - U.ur)(lp - U,Uj)D’ 

^ + Op(frp). 


i<j 


Thus, we can rewrite Rn as follows 


R 


n 


^ ^ i<j 

9 n 

+ - V'coujs^/^D^V + Op(crn), 

i=i 


and 

var(pR„) = {al + ^/x'^D"^SD~V)(l + o{l)). 
np 

Next, taking the same procedure as in the proof of Theorem 1, we can prove the assertion. 
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